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Amendments to the Claims 

1 . (Original ) Apparatus for indexing a Web page which incorporates multirnedi a data by 
reference to one or more resources which supply said multimedia data, said method comprising, 
in combination: 

means for analyzing said web page to identify at least one markup tag containing a 
reference to a given one of said resources, 

means for selecting and executing a media processing program for analyzing the content 
of the multimedia data supplied by said given one of said resources to generate metadata 
describing said content, 

means for formatting said metadata into a character-based text annotation, 

means for combining said Web page and said annotation to form an enhanced Web page, 

and 

means for indexing said enhanced Web page. 

2. (original) Apparatus as set forth in claim 1 wherein said means for selecting and 
executing a media processing program comprises means for determining the particular data type 
of the multimedia data supplied by said given resource and means for selecting a processing 
program for analyzing multimedia data formatted in accordance with said particular data type. 

3. (original) Apparatus as set forth in claim 1 wherein said means for formatting said 
metadata compri se s means for generating a text data annotation expre ssed i n accordance with the 
Extensible Markup Language. 

4. (currently amended) Apparatus as set forth in claim 1 including means for acquiring 
additional metadata which describes the multimedia data supplied by said given one of said 
resources from a source other than the content of said multimedia data, and means for including 
said additional metadata in said character-based text annotation. 

5. (currently amended) Apparatus as set forth in claim 4 wherein at least some of said 

additional meta data includes informationobtainedfrom said one markup tag. 
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6. (currently amended) Apparatus as set forth in claim 4 wherein said given resource is 
accessed through the operating system of a computer which provides said given resource and 
wherein at least some of said additional meta data includes information obtained from said 
operating system. 

7. (currently amended) Apparatus as set forth in claim 4 wherein at least some of said 
additional information metadata s obtained via the Internet. 

8. (original) Apparatus for collecting and storing metadata describing a hypertext Web 
page, said Web page including markup tags which identify multimedia data from one or more 
different external resources, said apparatus compri si ng, in combination, 

a parser for identifying said markup tags in said Web page, 

processing means for analyzing the content of said multimedia data identified by said 
markuptagstogeneratemetadatadescribingsaidmultimediadata, 

meansfortranslatingsaidmetadataintoa character-based text annotation describing said 
multimedia data, and 

means for storing the combination of a copy of said Web page and said annotation to 
form an enhanced Web page suitable for processing by text-based indexing and searching 
facilities. 

9. (original) Apparatus as set forth in claims 8 wherein said text annotation is expressed 
in the Extensible Markup Language. 
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10. (original) The method of automatically enhancing the content of a Web page which 
contains multimedia data incorporated by reference which comprises, in combination, the steps 
of: 

identifying one or more markup tags in said Web page which respectively identify one or 

more external resources which provide said multimedia data; 

generating metadata which de scribessaidmultimediadata, 

translating saidmetadatainto a character-based textannotation, and 

inserting said annotation into said Webpage to form an enhanced Web page suitable for 

processing by a character-based text processing system. 

1 1 . (original) The method of automatically enhancing the content of a Web page as set 
forth in claim 10 wherein said step of identifying one or more markup tags comprises the stepsof 
first identifying markup tags in said Web page and extracting the uniform resource locator 
(URL) of one of said external resources from at least selected ones of said markup tags. 

12. (original)The methodof automatically enhancing the content of a Web page which 
contains multimedia data as set forth in claim 10 wherein said step of generating metadata 
includes the sub-steps of retrieving said multimedia data from said one or more external 
resources and analyzing the content of said multimediadatatoextractsaidmetadatatherefrom. 

13. (original) The method of automatically enhancing the content of a Web page as set 
forth in claim 12 wherein said step of generating metadata comprises the sub-steps of identifying 
the data type of the multimedia data from each of said resources and then selecting a processing 
routine for multimedia of the identified data type from each of said resources. 

14. (original) The method of automatically enhancing the content of a Web page as set 
forth in claim 10 includes the further step of indexing said enhanced Web page to provide access 
to said Web page in response to queries expressing one or more attributes expressed in said text 
annotation. 
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15. (original) The method of automatically enhancing the content of a Web page as set 
forth in claim 10 includes the further step of searching the content of said enhanced Web page in 
response to a search request to determine if attributes expressed in said search request are 
contained in said text annotation. 

16. (original) The method of automatically enhancing the content of a Web page as set 
forth in claim 13 includes the further step of indexing said enhanced Web page to provide access 
to said Web page in response to queries expressing one or more attributes expressed in said text 
annotation. 

17. (original) The method of automatically enhancing the content of a Web page as set 
forth in claim 13 includes the further step of searching the content of said enhanced Web page in 
response to a search request to determine if attributes expressed in said search request are 
contained in said text annotation. 
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